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Abstract — Two models for the calculation of ionization cross 
sections by electron impact on atoms, the Binary-Encouter-Bethe 
and the Deutsch-Mark models, have been implemented; they are 
intended to extend and improve Geant4 simulation capabilities 
in the energy range below 1 keV. The physics features of the 
implementation of the models are described, and their differences 
with respect to the original formulations are discussed. Results 
of the verification with respect to the original theoretical sources 
and of extensive validation with respect to experimental data 
are reported. The validation process also concerns the ionization 
cross sections included in the Evaluated Electron Data Library 
used by Geant4 for low energy electron transport. Among the 
three cross section options, the Deutsch-Mark model is identified 
as the most accurate at reproducing experimental data over the 
energy range subject to test. 

Index Terms — Monte Carlo, simulation, Geant4, electrons, 
ionization. 



I. Introduction 

VARIOUS experimental research topics require the capa- 
bility of simulating electron interactions with matter over 
a wide range - from the nano-scale to the macroscopic one: 
some examples are ongoing investigations on nanotechnology- 
based particle detectors, scintillators and gaseous detectors, 
radiation effects on semiconductor devices, background effects 
on X-ray telescopes and biological effects of radiation. 

Physics tools for the simulation of electron interactions are 
available in all Monte Carlo codes based on condensed and 
mixed transport schemes [1], like EGS [2], [3], FLUKA [4], 
[5], Geant4 [6], [7], MCNPX [8], Penelope [9] and PHITS 
[10]. General-purpose Monte Carlo codes based on these 
transport schemes typically handle particles with energy above 
1 keV; Geant4 and Penelope extend their coverage below this 
limit. 

In the lower energy end below 1 keV, so-called "track 
structure" codes handle particle interactions based on discrete 
transport schemes; they provide simulation capabilities limited 
to a single target, or a small number of target materials, and 
are typically developed for specific application purposes. Some 
examples of such codes are OREC [11], PARTRAC [12], 
Grosswendt's Monte Carlo for nanodosimetry [13], TRAMOS 
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[14], and Geant4 models for microdosimetry simulation in 
water [15]. 

The developments described in this paper address the prob- 
lem of endowing a general purpose, large scale Monte Carlo 
system for the first time with the capability of simulating 
electron impact ionisation down to the scale of a few tens 
of electronvolts for any target element. For this purpose, 
models of electron impact ionization cross sections suitable 
to extend Geant4 capabilities in the low energy range have 
been implemented and validated with respect to a large set of 
experimental measurements. 

The validation process, which involves experimental data 
pertinent to more than 50 elements, also addresses the ion- 
ization cross sections encompassed in the Evaluated Electron 
Data Library (EEDL) [16], which are used in Geant4 low 
energy electromagnetic package [17], [18]. To the best of the 
authors' knowledge, this is the first time that EEDL is subject 
to extensive experimental benchmarks below 1 keV. 

II. Overview of electron ionization in Geant4 

The Geant4 toolkit provides various implementations of 
electron ionization based on a condensed-discrete particle 
transport scheme. Two of them, respectively based on EEDL 
[19] and on the analytical models originally developed for 
the Penelope [9] Monte Carlo system, are included in the 
low energy electromagnetic package; another implementation 
is available in the standard [20] electromagnetic package. In 
addition, a specialized ionization model for interactions with 
thin layers of material, the photoabsorption-ionization (PAI) 
model [21], is implemented in Geant4. 

The EEDL data library tabulates electron ionization cross 
sections in the energy range between 10 eV and 100 GeV; nev- 
ertheless, due to intrinsic limitations of the accuracy of EEDL 
and its companion Evaluated Photon Data Libray (EPDL) [22] 
highlighted in the documentation of these compilations, the use 
of Geant4 low energy models based on them was originally 
recommended for incident electron energies above 250 eV 
[19]. This limit of applicability was an "educated guess" 
rather than a rigorous estimate of validity of the theoretical 
calculations tabulated in EEDL and EPDL. The lower energy 
limit of Penelope's applicability is generically indicated by its 
authors as "a few hundred electronvolts" [23]. The lower limit 
of applicability of Geant4 standard electromagnetic package 
is 1 keV. 

The validation of Geant4 models for electron transport based 
on the EEDL data library and on Penelope-like models is 
documented in [24] for what concerns the energy deposition 
in extended media. 
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Ionization models suitable for microdosimetry simulation, 
which operate in a discrete particle transport scheme, are 
available in Geant4 for electron interactions in water [15]; 
they are applicable for energies down to the electronvolt scale. 
The cross section models implemented in that context are 
specific to one material (liquid water); due to lack of pertinent 
experimental data, their validation is still pending. 

III. Software development process 

The developments described in this paper adopt an iterative- 
incremental process consistent with the Unified Process [25]. 
The features and results documented in the following sections 
correspond to the first cycle of a wider project concerning the 
development and assessment of models for multi-scale electron 
transport [26], [27], which is motivated by multi-disciplinary 
experimental applications. A characterizing feature of the 
Unified Process, which differentiates it from other widespread 
software life-cycle models adopting a waterfall [28] approach, 
is the production of concrete deliverables even at intermediate 
stages of the project: this development cycle has enabled 
the validation and comparative evaluation of different physics 
models, and has produced a data library usable in multiple 
environment. 

The software described and validated in the following 
sections is intended for release in the Geant4 toolkit following 
the publication of this paper. 

A. Physics models 

The developed software tools concern the calculation and 
validation of cross sections for the ionization of an atom by 
electron impact at energies below 10 keV: they are focused 
on the total cross section for single ionization, namely the 
emission of one electron from a neutral atom, irrespective 
of the shell from which the electron is emitted. Collective 
phenomena and solid state effects are outside their scope, as 
well as the treatment of electron interactions with matter other 
than ionization. 

Two ionization cross section models, which specifically 
address the low energy range, have been implemented: the 
Binary-Encounter-Bethe (BEB) model [29] and the Deutsch- 
Mark (DM) [30] model. Their accuracy at reproducing ex- 
perimental data is extensively investigated in the following 
sections, along with the validation of the ionization cross 
sections included in EEDL, currently used by Geant4. 

The theoretical models adopted in the software implemen- 
tation have a wider scope of applicability: they can calculate 
cross sections for the ionization of individual shells as well as 
for multiple ionized atoms and for molecules. The assessment 
of these additional capabilities is intended to be the object of 
further cycles in the software process, to be documented in 
dedicated papers. 

B. Software design 

The software adopts a policy-based class design [31]; this 
technique was first introduced in a general-purpose Monte 
Carlo system in [15]. This programming paradigm allows the 



exploitation of the developed models in different contexts with 
great versatility, without imposing the burden of inheritance 
from a pre-defined interface, since policies are syntax-oriented, 
rather than signature-oriented. 

Preliminary evaluations [32], [33] indicate that policy-based 
design contributes to achieve better computational perfor- 
mance than conventional inheritance in the calculation of 
cross sections, thanks to compile-time binding. This feature 
is relevant to the computationally intensive domain of Monte 
Carlo particle transport, especially at low energies, where 
discrete transport methods, involving a large number of steps 
and accounting for individual collisions with the interacting 
medium, may be required for precise calculation. 

The classes responsible for the calculation of ionization 
cross sections conform to the cross section policy defined in 
[32], [33]. The policy consists of a CrossSection function, 
whose arguments are associated with characteristics of the 
incident particle and the target atom; it returns the value of 
the cross section calculated in the conditions specified by the 
arguments. 

C. Implementation 

The Binary-Encounter-Bethe and Deutsch-Mark models are 
implemented according to the analytical formulations devised 
by their original authors. The implementation is based on the 
latest revisions of the models available in the literature. 

Both cross section calculations involve a few atomic param- 
eters; the Deutsch-Mark model also involves some empirical 
parameters derived from fits to experimental data. The soft- 
ware implementation is based on the parameters documented 
in the literature by the original authors of the theoretical 
models; alternative sources were used in the software imple- 
mentation, when the original sources are not publicly acces- 
sible, or not specified. The differences of the implementation 
with respect to the original models and their implications are 
discussed in detail in the following sections. 

D. Software Verification and Validation 

The verification process ascertained whether the cross 
sections calculated by the software implementation of the 
BEB and DM models are consistent with the original values 
published by the respective authors. The validation process 
involves comparisons with experimental data to ascertain 
whether the two new models and the EEDL data library 
describe electron ionization cross sections accurately. 

The software verification and validation follow the guide- 
lines of the pertinent IEEE Standard [34]. Nevertheless, these 
two processes are intertwined: the verification of compatibility 
with original calculations cannot be completly disjoint from 
the assessment whether any detected discrepancies would 
affect the model accuracy significantly with respect to exper- 
imental data. 

Some of the reference cross section values for the verifica- 
tion and validation process, which are not available in numer- 
ical format, were digitized from published plots by means of 
the Engauge [35] software. The uncertainty associated with the 
digitization process was evaluated by digitizing plots whose 
entries were known a priori; it is smaller than 1%. 
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IV. The Binary-Encounter-Bethe model 

A. Theoretical background 

The Binary-Encounter-Bethe model is a simplified version 
of the Binary-Encounter-Dipole (BED) model [29] proposed 
by Kim and Rudd to calculate electron impact ionisation cross 
sections. 

The BED model combines a modified form of the Mott cross 
section [36] with the Bethe theory [37]. Mott theory describes 
the collision of two free electrons: it is expected to give 
good results for small impact parameters, or hard collisions, 
but it must be corrected for large impact parameters, or soft 
collision, where dipole interaction is prevalent, especially at 
high incident electron energies. Several attempts have been 
made to simultaneously describe hard and soft collisions [38]- 
[41], but they generally failed in finding the proper mixing 
between these two different physical situations. 

The BED model was proposed to describe in a parameter- 
free fashion the impact of a free electron on a bound one: 
it is able to determine the proper mixing by requiring the 
asymptotic behaviour of the ionization cross section to co- 
incide with the one obtained in Bethe's theory, but some 
issues remain open on how to describe within the model 
the fact that the outgoing primary and secondary electrons 
are undistinguishable. This crucial feature is included only in 
the Mott cross section. These shortcomings can explain the 
observed difference between the predictions of the BED and 
Deutsch-Mark model, which, as discussed in the following 
section, is to a large extent a phenomenological description of 
ionization processes. 

The BED model prescribes procedures to evaluate the 
energy distribution of the ejected electron for each subshell 
using the binding energy, average kinetic energy and dipole 
oscillator strength for each subshell. The agreement of BED 
with known experimental data is of the order of 10% in the 
region from the threshold to some keV. 

The oscillator strengths required in the BED formula can 
be obtained by theoretical calculations or experimental pho- 
toionization cross sections; nevertheless, they are not easily 
available for every atom and for each subshell. Although 
the BED model shows qualitatively good agreement with 
experimental data for many atoms (e.g. H, He, Ne, Rb) 
[29], [42], the difficult availability of these components of its 
formulation limits its practical use. 

The BEB model [29] was proposed as a simplification of the 
BED model, when the differential dipole oscillator strength is 
unknown. It assumes a simple form for the oscillator strengths, 
which approximates the shape of the oscillator strength for 
ionization of the ground state of hydrogen. 

The BEB cross section for the ionization of subshell i is 
given by: 



&BEB, 
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In the above equations T is the incident electron energy, t and u 
are normalized incident and kinetic energies, n is the principal 
quantum number (only taken into account when greater than 
2), «o is the Bohr radius and R is the Rydberg constant. The 
BEB model involves three atomic parameters for each subshell 
of the target atom, as shown in (Q~|): the electron binding energy 
B, the average electron kinetic energy U and the occupation 
number N. The sum over all subshells i gives the total cross 
section; in practice, only the valence shell and a few outer 
subshells contribute significantly to determine the total cross 
section value. 

In equation (Q~|i, the term associated with the first logarith- 
mic function represents distant collisions (i. e. large impact 
parameters) dominated by the dipole interaction, and the rest 
of the terms represent close collisions described by the Mott 
cross section; the second logarithmic function originates from 
the interference of direct and exchange scattering. 

B. Implementation of the BEB model 

The BEB cross section model is implemented according to 

CD. 

The atomic parameters originally used by the authors of the 
model have been documented in the literature only for a small 
number of target elements; therefore, to satisfy the requirement 
of general applicability in a large scale Monte Carlo system, 
alternative compilations of parameters, covering the whole 
periodic system, are utilized in the software implementation. 

The electron binding energies (except for the valence elec- 
tron) and average electron kinetic energies appearing in the 
original formulation of the Binary-Encounter-Bethe model 
derive from relativistic Dirac-Fock calculations [43]; since the 
original numerical values are not publicly available, they were 
replaced in the code implementation by the values reported in 
in the Evaluated Atomic Data Library (EADL) [44]. EADL 
was also used in the software implementation to retrieve the 
occupation numbers of each subshell, since the source of these 
parameters in the original BEB calculations is not explicitly 
documented in the literature. 

The choice of EADL in the software implementation as 
an alternative source of the atomic parameters was mainly 
dictated by the limited availability of compilations of mean 
electron energies covering the whole periodic system; other 
parameters, such as atomic binding energies and occupation 
numbers, were taken from the same source for consistency. 

Both in the original formulation of the model and in the 
software implementation the binding energy for the valence 
electron is obtained from the compilation of experimental ion- 
ization energies [45] included in the NIST (National Institute 
of Standards and Technology) Physics Reference Data. 



C. Verification of the BEB model implementation 

The correctness of the BEB model implementation was 
verified by comparing quantitatively cross sections calculated 
with the same atomic parameters (binding energies, ionization 
potentials and electron kinetic energies) used by the original 
authors with reference values published in the literature. The 
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Fig. 1. BEB cross section for electron impact on gallium calculated by the 
software (white squares) and original values (black squares), as a function of 
energy. 
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Fig. 2. Effect of atomic parameters on BEB cross section for electron impact 
on nitrogen: cross sections calculated by the implemented software (white 
squares) with parameters as in section llV-BI original values (black squares), 
calculations as in section ITV-B I except for atomic binding energies taken from 
Lotz's compilation as in the DM model (asterisks) and for average electron 
kinetic energies as in the original formulation (white triangles), and with all 
atomic parameters taken from EADL (white circles). 



V. The Deutsch-Mark model 
A. Theoretical background 

The Deutsch-Mark formalism was originally developed for 
the calculation of atomic ionization cross sections [30]; it has 
been subject to evolution [46]-[50] since its first formulation. 

The DM model has its origin in a classical binary encounter 
approximation derived by Thomson [51] and its improved 
form by Gryzinski [52]. 

The current expression of the DM formula calculates the 
atomic cross section a dm for single ionization as the sum 
over all partial ionization cross sections corresponding to the 
removal of a single electron from a given atomic subshell, 
characterized by quantum numbers n and I as: 



n . / 



2 , Aq) ( , ( HCniu) 



(3) 



In this formula r„i is the radius of maximum radial density 
of the atomic subshell with quantum numbers n and I and 
£ n i is the electron occupation number in that subshell; g n i 
are weighting factors, which were determined by the original 
authors from a fitting procedure [30], [46] using experimental 
cross section data. The quantity u represents the reduced 
energy E/E n i, where E is the energy of the incident electron 
wdE n i is the ionization energy of the subshell identified by n 
and I quantum numbers. In the original authors' calculations 
the values of r n i were taken from Desclaux's compilation [53] 
and ionization energies form Lotz's compilation [54] of atomic 
binding energies. The c n i constant is close to one except 
for electrons in the d orbital. The sum extends over all the 
subshells of the target atom. 

The energy-dependent function has the form: 



Ai-A 2 
1 + (u/A 3 )p 



A 2 



(4) 



where Ax, A2, A3 and p are constants, that were determined 
from measured cross sections for the various values of n and I 
[49], [50]. The superscript q refers to the number of electrons 
in the subshell identified by n and I. 



results of the software implementation are consistent with the 
original references; an example is illustrated in Fig. Q] 

Nevertheless, as discussed in section HV-BI the software im- 
plementation uses different values of the the atomic parameters 
involved in (HJ, since the original ones are documented only 
for a small number of elements. The resulting cross section 
values are sensitive to this modification, as one can observe 
in Fig. |2j the extent of alteration with respect to the original 
values depends on the element. 

An extensive investigation of the effect of atomic electron 
binding energies on various physics quantities relevant to 
Monte Carlo particle transport, including the cross sections 
calculated by the BEB model, is reported in [55]. The effect 
of atomic parameters on the accuracy of the BEB model at 
reproducing experimental data is discussed in section IVIIII 



B. Implementation of the DM model 

The DM cross section model is implemented according to 
©. Most of the parameters in the implementation are taken 
from the sources documented by the original authors. 

The values of the radius of maximal radial density derive 
from the review by Desclaux [53] as in the original model. 
The parameters of the energy dependent function are those 
reported in an original reference [49]. 

Atomic electron binding energies derive from the compila- 
tion by Lotz [54], as in the original calculations, with the 
exception of the binding energies for the valence electron, 
which are taken from NIST collection of ionization energies 
[45] for consistency with the BEB implementation: however, 
Lotz's and NIST ionization energies are equivalent with 0.05 
significance [55]. Occupation numbers are also taken from 
NIST Physics Reference Data, while their source is not 
explicitly documented in the original formulation. 
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Fig. 3. DM cross section for electron impact on carbon calculated by the 
software (white triangles) and original values (black triangles), as a function 
of energy. 



2 3 

10 10 10 

Energy (eV) 

Fig. 4. DM cross section for electron impact on gadolinium calculated by the 
software (white triangles) and original values (black triangles), as a function 
of energy. 



Weighting factors in the software implementation are taken 
from original publications [46] and [47] (the former limited 
to the 7s orbital); although more recent values have been 
determined by the original authors [56], they could not be 
utilized in the current implementation, as they are not publicly 
documented. 

C. Verification of the DM model implementation 

The formulation of the DM model was revised in 2004; 
therefore, only cross section values published since then [48], 
[49], [57], [58] were considered as a reference in the software 
verification process. 

Original cross section values concerning 48 atoms were 
retrieved from the literature and compared to the correspond- 
ing values calculated by the software for the purpose of 
verification. Two examples of these comparisons are illustrated 
in Fig.[3]and|4] As shown in Fig.|5j in more than 2/3 of the test 
cases the average difference between original and calculated 
values is smaller than 5%; nevertheless, for a few target 
elements (namely argon, cerium and gadolinium) it is greater 
than 20%. Goodness-of-fit tests comparing the distributions of 
original and calculated cross sections confirm the rejection of 
the null hypothesis of compatibility with 0.05 significance in 
these cases exhibiting large discrepancies. 

The most probable source of the observed discrepancies 
between original and calculated values is the different set of 
weighting factors used in the software implementation and 
in recent Deutsch-Mark calculations, as discussed in section 
IV-BI This assumption was tested by empirically adjusting the 
weighting factors values in the software implementation; as 
a result of this operation, cross section values compatible 
within 1% with recently published reference ones could be 
obtained for the elements exhibiting large discrepancies in 
Fig. [5] Nevertheless, for better traceability of the results of 
the software, the published weighting factors of [46] and [47] 
were retained in the implementation. 

The role of these discrepancies on the capability of the 
DM model implementation to reproduce experimental data is 
discussed in section [Villi 
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Fig. 5. Average relative difference between DM cross sections calculated by 
the software and original values, as a function of the atomic number Z. 



VI. The Evaluated Electron Data Library 



The Evaluated Electron Data Library includes tabulations 
of ionization cross sections resulting from theoretical calcula- 
tions. 

For close collisions, the calculations use Seltzer's modi- 
fication [59] of M0ller's binary collision cross section [60], 
which takes into consideration the binding of atomic electrons 
in a given subshell. For distant collisions, they use Seltzer's 
modification [59] of Weizsacker- Williams' method [61], [62]; 
this approach is similar to the BED model in that it requires 
knowledge of the dipole oscillator strengths of the target, but, 
being primarily designed for high energy incident electrons, it 
may lead to unrealistic results below a few hundred eV. 

Calculations by Scofield [63] were used to take into account 
the density effect; this correction is significant for inner shell 
cross sections for incident electron energies above a few 
hundred MeV, but this effect sets in at lower energies for outer 
shells. 
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VII. Validation of electron cross section models 

The electron ionization cross sections calculated by the BEB 
and DM models, and those tabulated in EEDL are validated 
through comparison with experimental data. 

Cross sections for the ionization of atoms based on the BEB 
and DM models have been previously subject to comparison 
with experimental measurements (e.g. [46], [49], [57], [58], 
[68]— [71]); these comparisons involve a limited number of 
target elements and experimental data sets, and rely on qualita- 
tive visual appraisal of the compatibility between models and 
measurements. They concern calculations performed by the 
original authors, which, as discussed in the previous sections, 
in some cases cannot be reproduced, as not all the original 
parameters in the model formulation are publicly documented. 

To the best of the authors' knowledge, the accuracy of the 
EEDL ionization cross section calculations has not yet been 
quantitatively documented in the literature. 

The validation process described in this paper concerns 
the cross sections calculated by the software implementation, 
which, being intended for open source release along with the 
publication of this paper, are reproducible. It involves a wider 
collection of experimental data than previously published 
comparisons and concerns a larger number of elements; more- 
over, the compatibility between the models and experimental 
measurements is estimated quantitatively, based on statistical 
analysis methods. 

A. Experimental measurements 

The validation of the three electron ionization cross section 
models is based on a large set of experimental data [73] - [150] 
collected in the literature. The experiments were performed 
with different techniques and measured a variety of physical 
observables, which are not always exhaustively documented 
in the related publications. Some papers do not report the 
uncertainties of the measurements. 

The reference data include measurements of single ioniza- 
tion, i.e. the emission of a single electron as a result of the 
primary electron's impact, as well as experiments that did not 
distinguish whether more than one electron had been emitted 
from the target atom. When multiple ionization is involved, a 
further possible source of ambiguity depends on whether the 
measurements concerned the so-called "total counting" cross 
section, which accounts for the number of ions produced, 

"counting = 

or the so-called "total gross" cross section, which is deter- 
mined by measuring the total ion current, 

O-gross = ^ ^ ^ 

where n represents the number of ionizations. Multiple ion- 
ization is generally small with respect to single ionization: for 
instance, for several elements cross sections for double ion- 
ization amount to a few percent of those for single ionization, 
and cross sections for triple ionization are approximately an 
order of magnitude smaller than for double ionization [102]. 
Nevertheless, the contribution of double ionization may be 



significant for some elements: for instance, it represents more 
than 20% of single ionization for lead [102]. 

Some experiments measured absolute cross sections; some 
report relative values with respect to other references, which 
are either experimental or theoretical calculations. Both tech- 
niques have drawbacks: the intrinsic difficulty of making ac- 
curate absolute cross section measurements and the possibility 
of introducing a systematic bias in relative measurements. 

Other features likely to be associated with systematic effects 
can be identified in contradictory measurements of single and 
total (counting or gross) ionization cross sections: in some 
cases (for instance, as reported in [102] and [108], [109]) the 
experimental cross section for single ionization appears larger 
than measurements of total gross or counting cross section, of 
which single ionization should be a component. 

Large discrepancies are evident in some of the experimental 
data. Some data sets pertaining to the same target element 
are patently inconsistent; systematic effects are likely present 
in some cases, where the Wald-Wolfowitz test [151] detects 
sequences of positive or negative differences between experi- 
mental data sets, which are incompatible with randomness. 

The wide heterogeneity of the experimental data com- 
plicates the validation process; it suggests caution in the 
interpretation of results of agreement, or disagreement, of the 
theoretical models with individual measurements, and induce 
to privilege a statistical analysis over a wide experimental 
sample as an indicator of the reliability of the theoretical 
models for use in particle transport. 

B. Analysis method 

The analysis is articulated over two stages: the first one 
estimates the compatibility between cross section models and 
experimental data; the second one evaluates whether the three 
models exhibit any significant differences in their compatibil- 
ity with experiment. 

Cross sections are compared by means of statistical meth- 
ods: goodness-of-fit testing to evaluate the compatibility of 
the simulation models with experimental measurements for 
each element, and categorical analysis based on contingency 
tables to evaluate the overall differences in compatibility with 
experiment across the models. 

The null hypothesis in the goodness-of-fit tests is defined as 
the equivalence of the simulated and experimental data distri- 
butions subject to comparison. Unless differently specified, the 
significance level of the tests, defined as p-value determining 
the region of rejection of the null hypothesis, is 0.05. 

Goodness of fit tests are performed on pairs of cross section 
distributions; for this purpose theoretical BEB and DM cross 
sections are calculated at the same energies as the experimental 
data, and EEDL cross sections corresponding to these energies 
are obtained through interpolation from tabulated values. 

Two types of goodness of fit tests, implemented in the 
Statistical Toolkit [152], [153], are exploited in the validation 
process: the % 2 [154] test and three tests for unbinned dis- 
tributions based on the empirical distribution function. Their 
complementary characteristics address some peculiarities of 
the experimental sample, like the lack of documentation of 
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TABLE I 

Percentage of test cases in which cross section models are compatible with experimental data 







All 


ionization 


measurement 


Absolute 




JNO. data SCIS 


107 


75 


73 


44 


<20 eV 


BEB 


74±4 


71±5 


81±5 


80±6 


DM 


75==4 


75=b5 


81=b5 


84=b6 




EEDL 


36±5 


39±6 


38±6 


43±7 




1> U. Ud.Lt! sCLa 


129 


90 


83 


49 


20-50 eV 


BEB 
DM 


63±5 
71 ±4 


67±5 
76=b5 


53=1=6 
64=b6 


53=1=8 
69=b7 




EEDL 


17±4 


21±5 


13±4 


16±6 




1 > U. UilUI f»CLft 


124 


91 


81 


50 


50-100 eV 


BEB 
DM 


40±5 
66±5 


42=b6 
70=b5 


37=b6 
64=b6 


38=b7 
70=b7 




EEDL 


18±4 


24±5 


9±3 


14±5 




No. data sets 


127 




81 


51 


100-250 eV 


BEB 
DM 


44 ==5 
/u= i + 


51=b6 
74=b5 


38=b6 
67=b6 


45=b8 
73=b7 




EEDL 


39±5 


49±6 


28±5 


41±7 




No. data sets 


79 


58 


43 


26 


250 eV-1 keV 


BEB 


62±5 


76±5 


58±6 


81=1=6 


DM 


78±4 


86±4 


72±5 


85±5 




EEDL 


67±5 


79±5 


65±6 


88±5 




No. data sets 


25 


22 


12 


11 


>1 keV 


BEB 


56±5 


64±6 


75±5 


82±6 


DM 


88±3 


91=1=3 


92±3 


91±4 




EEDL 


72±4 


73±5 


100-12 


100-15 



some experimental uncertainties or their questionable estimate, 
and mitigate the risk of possible systematic effects in the 
validation results related to the mathematical formulation of a 
single algorithm. 

Among non-parametric goodness-of-fit tests, the x 2 test 
takes into account experimental uncertainties explicitly. It is 
applied in this analysis whenever experimental errors are re- 
ported in the literature and the experimental sample subject to 
test encompasses at least five data (i.e. the x 2 test is considered 
applicable according to statistics practice). The x 2 test statistic 
is affected by the correct appraisal of the experimental errors: 
their unrealistic estimation may lead to incorrect conclusions 
regarding the rejection of the null hypothesis. 

The Kolmogorov-Smirnov [155], [156], Anderson-Darling 
[157], [158] and Cramer-von Mises [159], [160] tests are 
applied to all comparisons. They are the only means of com- 
paring distributions when experimental errors are unknown, 
or the sample size is too small for the x 2 statistic to be 
meaningful; they provide complementary information about 
the compatibility of the compared distributions in the cases 
where the x 2 test is applicable, but the experimental errors 
might have not been estimated realistically. 

A criterion is defined to combine the results of the different 
tests: the null hypothesis is not rejected if either the p-value of 
the x 2 test or the p-values of at least two out of three unbinned 
goodness-of-fit tests are larger than the significance level. The 
combined criterion privileges the outcome of the x 2 test, which 
takes into account experimental uncertainties explicitly, and 
requires some evidence of consistency from unbinned tests 
to accept the hypothesis of compatibility with experiment in 
cases where experimental errors are unknown, or might have 
been underestimated. 

The cross section model exhibiting the largest number 
of test cases where the null hypothesis is not rejected (i.e. 



appearing as the most accurate at reproducing experiment) 
is taken as a reference in the categorical analysis; the other 
models are compared to it by means of contingency tables, 
to determine whether they exhibit any statistically significant 
difference of compatibility with measurements. 

Contingency tables are built on the basis of the results of 
goodness of fit tests on individual data samples, which are 
classified respectively as "fail" or "pass" according to whether 
the hypothesis of compatibility of experimental and calculated 
data is rejected or not according to the combined criterion. 

The null hypothesis in the analysis of a contingency table 
consists of assuming the equivalence of the two categories 
of models it compares, regarding their compatibility with 
experiment. 

Contingency tables are analyzed with Fisher's exact test 
[161] and with the x 2 test applying Yates continuity correction 
[162]; the latter ensures meaningful results even with small 
number of entries in the table. Pearson x 2 test [163] is 
also performed on contingency tables, when their content is 
consistent with its applicability. The use of different tests in 
the analysis of contingency tables contributes to the robustness 
of the results, as it mitigates the risk of introducing systematic 
effects, which could be due to the peculiar mathematical 
features of a single test. 

A 0.05 significance level is set to determine the rejection 
of the null hypothesis in the analysis of contingency tables, 
unless specified differently. 

The statistical analysis is articulated in energy ranges rele- 
vant to the problem domain. The higher end above 1 keV is 
covered by all general-purpose Monte Carlo codes for particle 
transport; it is considered a conventional regime of calcula- 
tion of electron-photon interactions with matter. The energy 
range between 250 eV and 1 keV is relevant to simulation 
applications using the Geant4 low energy electromagnetic 



x 



package, regarding the validation of the current models and 
the comparison with other specialized cross section models 
not yet available in Geant4. The lower energy end, up to a 
few tens of eV, pertains to microdosimetry or nanodosimetry: 
the validation results assess how the implemented models, 
which specifically address this domain, would extend Geant4 
simulation capabilities for applications not yet covered by the 
toolkit. The assessment in the intermediate range quantitatively 
investigates the possibility of extending the applicability of 
existing Geant4 models below the current nominal limit of 
250 eV, or the need of new models, such as those studied in 
this paper, to fill the gap between the domain of microdosime- 
try simulation and conventional particle transport codes. 

VIII. Results 

The cross sections calculated by the BEB, DM and EEDL 
models are plotted in Figs. [1611721 along with experimental data. 
The results of their quantitative comparisons are detailed in 
the next section, while possible sources of systematic effects, 
which might affect the validation of the simulation models, 
are discussed in the following sections. 

A. Compatibility with experimental data 

The results of goodness-of-fit tests over all experimental 
data samples are summarized in Table HI they report the 
percentage of test cases in which the null hypothesis is 
not rejected, i.e. the theoretical models describe the data 
adequately. The table lists results for different experimental 
data types: the whole data sample, single ionization cross 
sections, absolute measurements, and absolute measurements 
of single ionization. 

The results over the whole data sample are visualized in 
Fig. [6] where one can observe that the DM model exhibits the 
best overall compatibility with experimental data, while EEDL 
capability at reproducing measurements drops significantly 
below the limit of 250 eV recommended for its use in Geant4. 

Fig. Q summarizes the results in relation to elements rather 
than individual experimental data sets; it shows the percentage 
of elements subject to test for which the null hypothesis is not 
rejected for at least one set of experimental measurements. The 
trend is quite similar to that observed in Fig. [6] with the DM 
model exhibiting in general the best capability at calculating 
cross sections compatible with experiment. 

Due to the discrepancies of measurements discussed in 
section IVII-AI the results reported in Table U and Figs. |6]|7] 
should not be interpreted straightforwardly as estimates of the 
efficiency of the implemented models at calculating correct 
cross sections The presence of experimental data affected by 
systematic errors contributes to underestimate the accuracy of 
theoretical models, which may appear compatible with only a 
subset of experimental data samples: Fig. [38] and Fig. [48] are 
an example. On the other hand, the contradiction of patently 
discrepant theoretical models that appear compatible with 
discrepant experimental data sets contributes to overestimate 
the accuracy: examples are Fig. @0] and Fig. [50] 

The categorical analysis estimates whether the differences 
of the models in compatibility with experiment are statistically 
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Energy range (eV) 

Fig. 6. Fraction of test cases in which cross sections calculated by 
the implemented models are compatible with experimental data at 0.05 
significance level: BEB model (blue squares), DM model (black triangles) 
and EEDL (red circles). The fraction is calculated over the whole collection 
of data sets. 
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0-20 20-50 50-100 100-250 250-1000 >1000 

Energy range (eV) 

Fig. 7. Fraction of elements subject to test for which cross sections calculated 
by the implemented models are compatible with at least one experimental data 
set at 0.05 significance level: BEB model (blue squares), DM model (black 
triangles) and EEDL (red circles). 

significant. The results are summarized in Tables [n] and [III] 
respectively comparing the compatibility of the BEB model 
and of EEDL over the whole collection of data samples, 
and in Table [IV] regarding the compatibility with at least one 
experimental sample per element. 

The outcome of this statistical analysis supports the quali- 
tative appraisal of Fig. [6] and [7] Over the whole collection of 
data samples, in the low energy range up to 50 eV the BEB 
model is equivalent to the DM one, while EEDL is statistically 
equivalent to the DM model above 250 eV. If one considers 
the compatibility with at least one experimental data set per 
element, the BEB model is statistically equivalent to the DM 
one also above 250 eV. 

Some possible sources of systematic effects, which may 
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bias the results of the validation process, are analyzed in the 
following sections. 

B. Data used in the determination of DM parameters 

Some of the parameters in the formulation of the Deutsch- 
Mark model are determined from a fit to experimental data. 
The reuse of experimental data to which model parameters 
were fit should be taken into account in the calculation of 
the number of degrees of freedom in the goodness-of-fit tests 
concerning those experimental data sets. Nevertheless, the 
calculation of proper degrees of freedom is hindered by the 
difficulty of ascertaining which experimental data were used 
for the determination of the weighting factors used in the DM 
model implementation, and what was actually fit. 

In the earliest version of the model the fit was based on 
a few experimental data sets for rare gases and uranium 
identified in [46], that were considered reliable by the original 
authors of the DM model. A later revision [164], which reports 
a subset of the weighting factors implemented in the software, 
mentions the inclusion of cross sections of small molecules in 
the determination of the new model parameters: this suggests 
a global fit for the determination of the weighting factors in 
(01 involving a set of molecules and atoms, which would have 
scarce relation with the issue of the degrees of freedom in 
goodness-of-fit tests concerning a single atom and a single 
experimental data sample. 

According to goodness-of-fit tests, some of the cross sec- 
tions calculated by the software are incompatible with 0.01 
significance with experimental data exploited in the original 
fit of [46]: this finding hints that they retain weak memory of 
having been involved in a fit for the determination of model 
parameters. A categorical analysis comparing the compliance 
with experimental data used in the original authors' fits and 
with data samples excluding them produces statistically equiv- 
alent results. These observations suggest that the goodness-of- 
fit analysis for the validation of the DM model applied in this 
paper is not significantly affected by the inclusion of a small 
subset of experimental data, which may have been somehow 
involved in the determination of the model parameters. 

C. Effect of BEB model parameters 

As shown in section IIV-CI the replacement of the atomic 
parameters used in the original formulation affects the value of 
the cross sections calculated by the BEB model. The effect of 
different values of the atomic parameters on the compatibility 
of the model with measurements is illustrated in Fig. [S] 
which compares the fraction of test cases in which BEB cross 
sections calculated with different atomic atomic parameters in 
(Q} are consistent with experimental data at 0.05 significance 
level. 

The influence of atomic parameters on the accuracy of the 
cross sections has been estimated through a sensitivity analysis 
considering the compatibility with experiment:. Cross sections 
were calculated with parameters as in the original model 
formulation, as in the software implementation, and with 
original average electron kinetic energies along with the other 
parameters as described in section ITV-B I The comparisons with 




o 
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0-20 20-100 100-250 250-1000 >1000 
Energy range (eV) 

Fig. 8. Fraction of test cases in which BEB cross sections calculated with 
different atomic atomic parameters in (T} are compatible with experimental 
data at 0.05 significance level: with parameters as in the software imple- 
mentation described in section llV-BI (blue squares), as in the original model 
formulation (pink diamonds) and as in section IIV-B I except for the average 
electron kinetic energies, which are as in the original model formulation (white 
circles). The analysis of compatibility reported in the plot is limited to the 
subset of elements for which the original parameters are documented in the 
literature. 



experimental data concerning calculations based on original 
parameters are necessarily limited to the elements for which 
original parameter values could be retrieved in the literature. 

The differences in compatibility with experiment are small, 
and a categorical analysis based on contingency tables con- 
firms the equivalence of the different calculations. Neverthe- 
less, apart from the lowest energy range, the cross sections 
calculated with the original parameters exhibit systematically 
greater compatibility with experiment than those resulting 
from modified parameters. The difference in compatibility 
related to different values of the average electron kinetic 
energies appears small; this observation suggests that the main 
source of differences is related to atomic binding energies 
and occupation numbers. In particular, the value of the first 
ionization potential plays a significant role in determining the 
accuracy of BEB cross sections, as one can observe in Fig. 
[9] which compares cross sections calculated with NIST and 
EADL ionization potentials. An extensive evaluation of atomic 
binding energies and their effect in particle transport can be 
found in [55]. 

The apparent overall better performance of the model with 
the original parameters suggests that improved accuracy could 
be achieved by optimizing the source of the atomic binding 
energies to be used in the calculation. However, this is not a 
straightforward operation, since consistency should be ensured 
with other atomic parameters, namely occupation numbers and 
electron kinetic energies, involved in the formulation of the 
model. 

D. Effect of DM model parameters 

As discussed in section IV-CI the cross sections calculated 
by the software exhibit some differences with respect to those 
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TABLE II 



Contingency tables related to DM and BEB cross section compatibility with experimental data 



Energy 


Goodness-of-fit test 


All 


Single 
ionization 


Absolute 
measurement 


Single 
Absolute 






DM BEB 


DM BEB 


DM BEB 


DM BEB 




Pass 


80 79 


56 53 


59 59 


37 35 


< 20 eV 


Fail 


27 28 


19 22 


14 14 


7 9 


p-value Fisher test 


1 


0.714 


1 


0.783 




p-value Pearson \^ 


0.876 


0.583 


1 


0.580 




p-value Yates 


1 


0.714 


1 


0.782 






DM BEB 


DM BEB 


DM BEB 


DM BEB 




Pass 


91 81 


68 60 


53 44 


34 26 


20-50 eV 


Fail 


38 48 


22 30 


30 39 


15 23 


p-value Fisher test 


0.235 


0.250 


0.208 


0.146 




p-value Pearson \ 


0.187 


0.188 


0.156 


0.097 




p-value Yates 


0.235 


0.250 


0.208 


0.147 






DM BEB 


DM BEB 


DM BEB 


DM BEB 




Pass 


82 49 


64 38 


52 30 


35 19 


50-100 eV 


Fail 


42 75 


27 53 


29 51 


15 31 


p-value Fisher test 


< 0.001 


< 0.001 


0.001 


0.002 




p-value Pearson 


< 0.001 


< 0.001 


0.001 


0.001 




p- value Yates 


< 0.001 


< 0.001 


0.001 


0.003 






DM BEB 


DM BEB 


DM BEB 


DM BEB 




Pass 


89 56 


69 47 


54 31 


37 23 


100-250 eV 


Fail 


38 71 


24 46 


27 50 


14 28 


p-value Fisher test 


< 0.001 


0.001 


< 0.001 


0.009 




p-value Pearson \ 


< 0.001 


0.001 


< 0.001 


0.005 




p-value Yates 


< 0.001 


0.001 


0.001 


0.009 






DM BEB 


DM BEB 


DM BEB 


DM BEB 




Pass 


62 49 


50 44 


31 25 


22 21 


250 eV - 1 keV 


Fail 


17 30 


8 14 


12 18 


4 5 


p-value Fisher test 


0.036 


0.236 


0.258 


1 




p-value Pearson \ 2 


0.024 


0.155 


0.175 


not applicable 




p-value Yates \ 2 


0.037 


0.236 


0.258 


1 






DM BEB 


DM BEB 


DM BEB 


DM BEB 




Pass 


22 14 


20 14 


11 9 


10 9 


> 1 keV 


Fail 


3 11 


2 8 


1 3 


1 2 




p-value Fisher test 


0.025 


0.069 


0.590 


1 




p-value Yates \ 2 


0.027 


0.072 


0.584 


1 



reported in recent publications by the original authors of the 
model. 

The observed discrepancy is not a source of concern for the 
accuracy of the software. In fact, when subject to the validation 
process described in section IVII1 the calculated DM cross 
sections are compatible with experimental data in most of the 
test cases exhibiting relatively large discrepancies with respect 
to recently published original values: apart from cerium, 
gadolinium and dysprosium, all the elements exhibiting greater 
than 10% average difference with respect to original references 
are compatible with experimental data with 0.05 significance 
over the energy range covered by measurements; the calcu- 
lations for gadolinium and dysprosium are compatible with 
measurements above 20 eV. It is worthwhile to note that also 
the cross sections for cerium, gadolinium and dysprosium 
recently published by the original authors [58] exhibit visible 
differences with respect to experimental data. Regarding the 
discrepancy between calculated and original cross sections for 
argon, the controversial experimental situation depicted in Fig. 
[5T|hinders the assessment of which calculation would produce 
more reliable cross sections. 

The verification and validation analysis suggests that, given 
the quality of the available measurements, there is room 
for some flexibility in the determination of the DM model 
parameters deriving from a fit to experimental data: different 



parameters may modify the value of cross sections without 
affecting substantially the overall accuracy of the model with 
respect to experimental references. 

It is worthwhile to note that, while a sensitivity analysis of 
the BEB model implementation to different values of atomic 
parameters appearing in its formulation, like electron binding 
energies, was feasible, a similar procedure would not be 
straightforward for the DM model, whose formulation is the 
result of a global fit performed by the original authors. 

E. Dependency on the type of cross section measurement 

The theoretical models considered in this paper concern the 
calculation of cross sections for single ionization, while the 
experimental data to which they are compared include both 
measurements of single and "total counting" or "total gross" 
cross sections, that also account for multiple ionization. In 
principle the former should be more reliable references for the 
validation process, as the comparison would involve consistent 
physics quantities; nevertheless, this assumption could be 
invalidated by the heterogeneous quality of the experimental 
measurements discussed in section [VII- Al 

Some of the experimental data involved in the validation 
are relative cross sections with respect to reference values 
taken from other theoretical or experimental sources: for 
instance, several cross sections are reported relative to the 
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TABLE III 



Contingency tables related to DM and EEDL cross section compatibility with experimental data 





Goodness-of-fit test 


All 


Single 
ionization 


Absolute 
measurement 


Single 
Absolute 






DM EEDL 


DM EEDL 


DM EEDL 


DM EEDL 




Pass 


80 38 


56 29 


59 28 


37 19 


< 20 eV 


Fail 


27 69 


19 46 


14 45 


7 25 


p-value Fisher test 


< 0.001 


< 0.001 


< 0.001 


< 0.001 




p-value Pearson \^ 


< 0.001 


< 0.001 


< 0.001 


< 0.001 




p-value Yates x 2 


< 0.001 


< 0.001 


< 0.001 


< 0.001 






DM EEDL 


DM EEDL 


DM EEDL 


DM EEDL 




Pass 


91 22 


68 19 


53 11 


34 8 


20-50 eV 


Fail 


38 107 


22 71 


30 72 


15 41 


p-value Fisher test 


< 0.001 


< 0.001 


< 0.001 


< 0.001 




p-value Pearson \^ 


< 0.001 


< 0.001 


< 0.001 


< 0.001 




p-value Yates x 2 


< 0.001 


< 0.001 


< 0.001 


< 0.001 






DM EEDL 


DM EEDL 


DM EEDL 


DM EEDL 




Pass 


82 22 


64 22 


52 7 


35 7 


50-100 eV 


Fail 


42 102 


27 69 


29 74 


15 43 


p-value Fisher test 


< 0.001 


< 0.001 


< 0.001 


< 0.001 




p-value Pearson 


< 0.001 


< 0.001 


< 0.001 


< 0.001 




p- value Yates x 2 


< 0.001 


< 0.001 


< 0.001 


< 0.001 






DM EEDL 


DM EEDL 


DM EEDL 


DM EEDL 




Pass 


89 49 


69 46 


54 23 


37 21 


100-250 eV 


Fail 


38 78 


24 47 


27 58 


14 30 


p-value Fisher test 


< 0.001 


0.001 


< 0.001 


0.003 




p-value Pearson 


< 0.001 


0.001 


< 0.001 


0.001 




p- value Yates ^ ^ 


< 0.001 


0.001 


< 0.001 


0.003 






DM EEDL 


DM EEDL 


DM EEDL 


DM EEDL 




Pass 


62 53 


50 46 


31 28 


22 23 


250 eV - 1 keV 


Fail 


17 26 


8 12 


12 15 


4 3 


p-value Fisher test 


0.152 


0.462 


0.643 


1 




p-value Pearson \ 2 


0.108 


0.326 


0.486 


not applicable 




p-value Yates x 2 


0.153 


0.461 


0.642 


1 






DM EEDL 


DM EEDL 


DM EEDL 


DM EEDL 




Pass 


22 18 


20 16 


11 12 


10 11 


> 1 keV 


Fail 


3 7 


2 6 


1 


1 




p-value Fisher test 


0.289 


0.240 


1 


1 




p-value Yates \ 2 


0.289 


0.241 


1 


1 



measurements of [78], while examples of normalization with 
respect to theoretical calculations are the measurements of 
[99] (relative to Bray's calculations [165] at 15 eV) and of 
[103] (relative to McGuire's calculations [166] at 500 eV). 
The normalization procedure is prone to introduce further 
uncertainties and possible biases in the reference data. 

The fraction of test cases which are compatible with exper- 
iment is shown in Figs. [TOlfTSl for different types of experi- 
mental references: the whole sample, measurements of single 
ionization only, absolute cross section measurements only, and 
absolute measurements of single ionization. The consistency 
of the DM model with experiment appears independent from 
the type of reference data, while for BEB and EEDL cross 
sections one can observe some increased compatibility with 
measurements concerning single ionization. 

The relative trend of compatibility with experiment of the 
three cross section models is scarcely affected by the nature of 
the reference experimental data, as one can observe in Figs. 
[T3lfT5l to be compared with Fig. [6] reporting the fraction of 
compatible test cases for all types of measurement. 

The influence of the type of measurements in assessing 
the accuracy of a given model has been estimated through 
an analysis of compatibility with alternative categories of 
experimental references: single ionization and total counting 
or gross cross sections, absolute and relative measurements. 



The analysis, summarized in Tables [V] and I VII is based on 
contingency tables, which report the "pass" and "fail" outcome 
of goodness-of-fit tests associated with either category of 
measurements in the various energy ranges. 

The DM model exhibits equivalent compatibility with single 
ionization measurements and total (counting or gross) exper- 
imental cross sections with 0.01 significance level over the 
whole energy range. The results are similar for the BEB model, 
with the exception of energy range between 250 eV and 1 keV, 
where the hypothesis of equivalent compatibility with experi- 
ment over the categories of single and total (counting or gross) 
cross section measurements is rejected with 0.01 significance. 
Regarding EEDL, equivalent behavior with respect to the two 
categories of experimental data is achieved at 0.01 significance 
level only in the low energy range below 50 eV and above 1 
keV. 

The BEB and DM model exhibit statistically equivalent 
behavior at 0.01 significance level with respect to absolute 
and relative measurements, with the exception of the energy 
range between 20 and 50 eV regarding the BEB model. No 
clear trend can be identified in EEDL compatibility with either 
type of measurements. 

The compatibility of the individual models with respect to 
different types of experimental measurements is reflected in 
their comparative analysis reported in Table [TTJ the results of 



12 



TABLE IV 

Contingency tables related to cross section compatibility with at least one experimental data set per element 



Fnprp"v 


Goodness-of-fit test 


Models 


Models 






DM BEB 


DM EEDL 




Pass 


40 43 


40 21 


< 20 eV 


Fail 


11 8 


11 30 


p-value Fisher test 


0.612 


< 0.001 




p-value Pearson 


0.445 


< 0.001 




p-value Yates 


0.611 


< 0.001 






DM BEB 


DM EEDL 




Pass 


44 37 


44 13 


20-50 eV 


Fail 


9 16 


9 40 


p-value Fisher test 


0.162 


< 0.001 




p-value Pearson \^ 


0.109 


< 0.001 




p-value Yates 


0.170 


< 0.001 






DM BEB 


DM EEDL 




Pass 


47 32 


47 17 


50-100 eV 


Fail 


7 22 


7 37 


p-value Fisher test 


0.001 


< 0.001 




p-value Pearson 


0.001 


< 0.001 




p-value Yates \^ 


0.002 


< 0.001 






DM BFB 


DM FFDI 




Pass 


50 31 


50 30 


100-250 eV 


Fail 


4 23 


4 24 


p-value Fisher test 


< 0.001 


< 0.001 




p- value Yates 


< 0.001 


< 0.001 






DM BEB 


DM EEDL 




Pass 


28 24 


28 24 


250 eV - 1 keV 


Fail 


7 11 


7 11 


p-value Fisher test 


0.413 


0.413 




p-value Pearson \ 2 


0.274 


0.274 




p-value Yates x 


0.412 


0.412 






DM BEB 


DM EEDL 




Pass 


12 8 


12 10 


> 1 keV 


Fail 


2 6 


2 4 




p-value Fisher test 


0.209 


0.648 




p-value Yates \ 2 


0.209 


0.645 



The sensitivity to the type of measurements above 250 eV 
suggests that the equivalence of the BEB and DM models at 
reproducing experimental data is somewhat marginal in this 
energy range, therefore small variations in the experimental 
sample over which the two models are evaluated are prone to 
perturb the outcome of their comparison. 

From this analysis one can conclude that the evaluation 
of the validity of the three models is scarcely affected by 
the type of experimental data taken as references: the DM 
model exhibits the best overall compatibility with experiment 
and its comparison with the other models produces consistent 
results at 0.01 significance level irrespective of the technique 
of measurement. 

F. Excitation-autoionization 

Apart from direct ionization, which accounts for the ejection 
of a bound electron directly into the continuum, additional 
indirect channels of ionization may be important for open- 
shell atoms, such as the excitation of an inner-shell electron 
to an upper bound state that leads to autoionization [69]. 
Their contribution is generally included in the experimental 
measurements of total cross section for single ionization, 
which do not distinguish direct and indirect channels. 

Contributions of indirect channels are not taken into account 
by the BEB model, which describes only cross sections for 
direct ionization, while their non explicit treatment could be 




0-20 20-50 50-100 100-250 250-1000 >1000 
Energy range (eV) 



Fig. 9. Fraction of test cases in which BEB cross sections calculated 
with NIST ionization potentials (black squares) or with EADL ones (grey 
diamonds) in (T} are compatible with experimental data at 0.05 significance 
level. 



comparison with respect to the DM model are consistent for 
all types of measurements up to 250 eV, but above 250 eV the 
BEB model is statistically equivalent with 0.05 significance to 
the DM one with respect to measurements of single ionization 
and absolute cross sections, while their compatibility is limited 
to 0.01 significance over the whole collection of data samples. 
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TABLE V 

Contingency tables comparing the compatibility of theoretical models with single and total (counting or gross) cross section 

measurements 



Energy 


Goodness-of-fit test 


it j- it 


D1V1 








Single Total 


Single Total 


Single Total 




Pass 


53 26 


56 24 


29 9 


< 20 eV 


ran 


99 A 
ZZ O 


1 Q S 


40 ZJ 


p-value Fisher test 


0.339 


1 


0.3 /V 




1 T» 2 

p-value Pearson \ 


0.254 


0.971 


0.297 




p-value Yates x 2 


n 9*;q 
0.305 


1 


UAL 1 




Pass 


Single Total 
60 21 


Single Total 
68 23 


Single Total 
19 3 


20-50 eV 


rail 


in 1 q 
3U 10 


ZZ ID 
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Fig. 10. Fraction of test cases in which BEB cross sections are compatible 
with experiment at 0.05 significance level, for different types of measurements: 
all measurements (black squares), single ionization (white squares), absolute 
cross section measurements (grey squares) and absolute measurements of 
single ionization (crosses). 



Fig. 11. Fraction of test cases in which DM cross sections are compatible 
with experiment at 0.05 significance level, for different types of measurements: 
all measurements (black triangles), single ionization (white triangles), absolute 
cross section measurements (grey triangles) and absolute measurements of 
single ionization (crosses). 
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TABLE VI 

Contingency tables comparing the compatibility of theoretical models with absolute and relative cross section measurements 



Rnerpv 


Goodness-of-fit test 


BEB 


DM 


EEDL 






Absolute Relative 


Absolute Relative 


Absolute Relative 




Pass 


59 20 


59 21 


28 10 


< 20 eV 


Fail 


14 14 


14 13 


45 24 


p-value Fisher test 


0.020 


0.054 


0.395 




p-value Pearson \^ 


0.016 


0.035 


0.368 




p-value Yates 


0.030 


0.061 


0.494 






Absolute Relative 


Absolute Relative 


Absolute Relative 




Pass 


44 37 


53 38 


11 11 


20-50 eV 


Fail 


39 9 


30 8 


72 35 


p-value Fisher test 


0.002 


0.028 


0.146 




p-value Pearson \^ 


0.002 


0.025 


0.123 




p-value Yates \^ 


0.004 


0.042 


0.194 






Absolute Relative 


Absolute Relative 


Absolute Relative 




Pass 


30 19 


52 30 


7 15 


50-100 eV 


Fail 


51 24 


29 13 


74 28 


p-value Fisher test 


0.448 


0.557 


< 0.001 




p-value Pearson \^ 


0.438 


0.533 


< 0.001 




p-value Yates \^ 


0.561 


0.671 


0.001 
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Absolute Relative 




Pass 


31 25 
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100-250 eV 


Fail 


50 21 


27 11 
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p-value Fisher test 


0.095 


0.316 


0.002 




p-value Pearson \ 


0.079 


0.265 


0.002 




p- value Yates ^ 


0.117 


0.361 


0.003 
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Absolute Relative 




Pass 
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23 20 


250 eV - 1 keV 


Fail 


12 12 
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p-value Fisher test 


1 


1 


0.595 




p-value Pearson \ 2 


0.921 


0.848 


0.530 




p-value Yates \ 2 


0.872 


0.934 


0.721 






Absolute Relative 


Absolute Relative 


Absolute Relative 




Pass 


9 5 


11 11 


12 6 


> 1 keV 


Fail 


3 8 


1 2 


7 




p-value Fisher test 


0.111 


1 


0.005 




p-value Yates \ 2 


0.151 


0.941 


0.011 



partly mitigated by the semi-empirical nature of the Deutsch- 
Mark model. The results of the validation process in some 
way reflect this different approach of the BEB and DM model 
towards the physics phenomena that contribute to experimen- 
tally measured ionization cross sections. 

The neglected contribution of excitation-autoionization 
could be also a reason for the rather poor compatibility of 
EEDL with experiment below 250 eV; nevertheless, no firm 
conclusion can be drawn in this respect due to the scarce 
documentation of how EEDL tabulations have been calculated. 

Methods to calculate cross sections for excitation- 
autoionization are documented in the literature [69] and would 
be considered in future development cycles to include this 
process among the interactions treated by Geant4. 

IX. Electron cross section data library 

The minimalist character of the software design and its 
minimal dependencies on other parts of Geant4 facilitate the 
exploitation of the developments described in this paper. 

The developed cross section classes can be used in asso- 
ciation with the Geant4 toolkit for the simulation of electron 
ionization as a discrete process, through the mechanism of a 
policy host class as described in [15], [32], [33]. The BEB and 
DM cross section code can also be exploited for the creation 
of data libraries to be used in the current Geant4 scheme, thus 




o 1 1 1 1 1 1 

0-20 20-50 50-100 100-250 250-1000 >1000 



Energy range (eV) 



Fig. 12. Fraction of test cases in which EEDL cross sections are compatible 
with experiment at 0.05 significance level, for different types of measurements: 
all measurements (black circles), single ionization (white circles), absolute 
cross section measurements (grey circles) and absolute measurements of single 
ionization (crosses). 
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Energy range (eV) 



0-20 20-50 50-100 100-250 250-1000 >1000 
Energy range (eV) 



Fig. 13. Fraction of test cases in which cross sections calculated by the 
three models are compatible with single ionization measurements at 0.05 
significance level: BEB model (blue squares), DM model (black triangles) 
and EEDL (red circles). 



Fig. 15. Fraction of test cases in which cross sections calculated by the three 
models are compatible with absolute measurements of single ionization cross 
sections at 0.05 significance level: BEB model (blue squares), DM model 
(black triangles) and EEDL (red circles). 




0-20 20-50 50-100 100-250 250-1000 >1000 
Energy range (eV) 



Fig. 14. Fraction of test cases in which cross sections calculated by the three 
models are compatible with absolute ionization cross section measurements at 
0.05 significance level: BEB model (blue squares), DM model (black triangles) 
and EEDL (red circles). 



extending Geant4 simulation capabilities below the current 250 
eV limit recommended for the use of the EEDL library. 

A data library consisting of tabulations of ionization cross 
section calculated by the BEB and DM models has been 
produced exploiting the software developments described in 
this paper; the cross sections are tabulated at the same energies 
as in the EEDL data library. This data library can be used at the 
place of the current EEDL data in connection with existing im- 
plementations of Geant4 ionization process, thus giving access 
to the extended energy coverage and the improved accuracy 
of the new models in a transparent way. Its possible use is not 
limited to Geant4; given its wider interest, it is intended to be 
publicly distributed independently from Geant4 through the 
Radiation Safety Information Computational Center (RSICC) 
following the publication of this paper. 



X. Conclusion 

Two models for the calculation of the cross sections for the 
ionization of atoms by electron impact, specialized in the low 
energy range, have been implemented: the Binary-Encounter- 
Bethe model and the Deutsch-Mark model. These models are 
intended to extend and improve the current capabilities of 
Geant4 for precision simulation of electron interactions. 

The cross sections calculated by these models, as well as 
those included in the Evaluated Electron Data Library, have 
been subject to extensive validation in the energy range from 
a few eV to 10 keV. 

Among the cross section models analyzed in this paper, 
the validation analysis has identified the Deutsch-Mark model 
as the most accurate for modeling electron ionization over 
the whole energy range considered in the test. The EEDL 
cross sections exhibit statistically equivalent accuracy in the 
energy range above 250 eV, in which they were originally 
recommended for use in Geant4; they are not adequately 
accurate to extend their usage below this threshold. In the 
lower energy end the Binary Encounter Bethe models exhibits 
statistically equivalent accuracy with respect to the Deutsch- 
Mark one; nevertheless, its performance appears to degrade at 
higher energies, presumably because it does not account for 
other channels than direct ionization. 

Possible sources of systematic effects, which could affect 
the accuracy of the implementation of the theoretical models or 
the outcome of the validation process, have been analyzed. The 
values of atomic parameters, namely atomic binding energies, 
play a significant role in determining the accuracy of the 
calculated cross sections. 

A cross section data library has been developed, containing 
tabulations of ionization cross sections calculated by the 
software described in this paper; it is meant for public release 
following the publication of this paper. The availability of 
cross section tabulations in a publicly distributed data library 
would extend the possibility of using them in other simulation 
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systems than Geant4. 

The models investigated in this paper provide more extended 
capabilities, that have not been exploited yet in the first 
development cycle described in this paper: they can describe 
the ionization of molecules, which could be of interest for the 
simulation of gaseous detectors and plasma interactions, and 
can calculate cross section for the ionization of inner shells, 
thus enabling the simulation of atomic relaxation determined 
by a vacancy in the shell occupation. Such extensions and 
improvements, as well as the development of complementary 
models for final state generation, are intended to be the object 
of further developments. 

The described developments for the first time endow a 
general-purpose Monte Carlo simulation system of the ca- 
pability of modeling electron ionization down to the energy 
scale relevant to nanodosimetry, for target elements spanning 
the whole periodic system. Nevertheless, it is worthwhile to 
recall that other phenomena, apart from direct ionization of 
atoms, should be taken into account for realistic simulation of 
particle interactions at very low energies: further effort should 
be invested for Geant4 to achieve full functionality for particle 
transport at nano-scale. 

Due to the already significant length of this paper and its 
focus on cross section modeling and validation, applications 
of the models to real-life experimental topics are meant to be 
covered in dedicated papers. 
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Fig. 16. Cross section, Z=l: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [73] (black 
circles), Boksenberg (reported in [72] (red squares), [74] (blue triangles) and 
[75] (green upside-down triangles). 
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Fig. 17. Cross section, Z=2: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [76] (black 
circles), [77] (pink stars), [78] (red squares), [79] (blue triangles), [80] (green 
upside-down triangles), [81] (turquoise asterisks), [82] (black squares), [83] 
(black triangles) and [84] (black stars). 
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Fig. 18. Cross section, Z=3: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [85] (black 
circles), [86] (red squares) and [87] (blue triangles). 
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Cross section, Z=6: EEDL (empty circles), BEB model (empty Fi g- 22 - Cross section ' Z=9: EEDL ( em P'y ckcles )' BEB model ( em P l y 
DM model (empty triangles) and experimental data from [88] (black squares), DM model (empty squares) and experimental data from [1 1 1] (black 

circles). 




Fig. 20. Cross section, Z=7: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [88] (black 
circles), [89] (red squares) and [90] (blue triangles). 




Fig. 23. Cross section, Z=10: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles), experimental data from [78] (black 
circles), [76] (black squares), [94] (black asterisks), [95] (blue triangles), [96] 
(red squares), [81] (green upside-down triangles), [83] (black upside-down 
triangles), [79] (black triangles), [97] (turquoise asterisks), [80] (pink stars) 
and [84] (black stars). 
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Fig. 21. Cross section, Z=8: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [91] 
(black circles), Boksenberg (reported in [72] (turquoise asterisks), [88] (blue 
triangles), [92] (green upside-down triangles), [75] (pink stars) and [93] (red 
squares). 
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Fig. 24. Cross section, Z=ll: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [85] (green 
upside-down triangles), [86] (turquoise asterisks), [98] (pink stars), [99] (black 
circles), [100] (blue triangles) and [101] (red squares). 
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Fig. 25. Cross section, Z=12: EEDL (empty circles), BEB model (empty pig. 28. Cross section, 2=15: EEDL (empty circles), BEB model (empty 

squares), DM model (empty triangles) and experimental data from [102] (pink squares), DM model (empty triangles) and experimental data from [102] 

stars), [103] (red squares), [104] (blue triangles), [105] (black circles), [106] (black circles), 
(green upside-down triangles) and [107] (turquoise asterisks). 
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Fig. 26. Cross section, Z=13: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] 
(black circles), [108] (red squares) and [109] (blue triangles). 
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Fig. 29. Cross section, Z=16: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] 
(black circles) and [110] (red squares). 
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Fig. 27. Cross section, 2=14: EEDL (empty circles), BEB model (empty Fig- 30. Cross section, 2=17: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] squares), DM model (empty triangles) and experimental data from [111] 
(black circles). (black circles). 
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Fig. 31. Cross section, Z=18: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [76] (green 
upside-down triangles), [112] (black squares), [84] (black triangles), [81] (red 
squares), [113] (blue triangles), [114] (black circles), [83] (pink stars), [78] 
(turquoise asterisks), [115] (red triangles) and [80] (red circles). 
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Fig. 34. Cross section, Z=22: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from Koparnski 
reported in [46] (black circles). 
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Fig. 32. Cross section, Z=19: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [85] (black 
circles), [86] (red squares), [98] (pink stars), [116] (blue triangles) and [117] 
(green upside-down triangles). 
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Fig. 35. Cross section, Z=23: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from Koparnski 
reported in [46] (black circles). 
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Fig. 33. Cross section, Z=20: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [106] 
(black circles), [118] (blue triangles), [119] (green upside-down triangles), 
[120] (red squares) and [121] (pink stars). 
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Fig. 36. Cross section, Z=26: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] (red 
squares) and [122] (black circles). 
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Fig. 37. Cross section, Z=28: EEDL (empty circles), BEB model (empty Fig. 40. Cross section, Z=31: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from Kopamski squares), DM model (empty triangles) and experimental data from [127] (blue 
reported in [46] (black circles). triangles), [128] (red squares) and [129] (black circles). 
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Fig. 38. Cross section, Z=29: EEDL (empty circles), BEB model (empty Fig. 41. Cross section, Z=32: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] (red squares), DM model (empty triangles) and experimental data from [102] 
squares), [123] (black circles), [124] (blue triangles) and [125] (pink stars). (black circles). 
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Fig. 39. Cross section, Z=3(): EEDL (empty circles), BEB model (empty Fig. 42. Cross section, Z=33: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [126] squares), DM model (empty triangles) and experimental data from [102] 
(black circles). (black circles). 
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Fig. 43. Cross section, Z=34: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] 
(black circles). 
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Fig. 44. Cross section, Z=35: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [111] 
(black circles). 
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Fig. 46. Cross section, Z=37: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [85] (blue 
triangles), [86] (black circles), [98] (pink stars), [116] (turquoise asterisks), 
[130] (red squares) and [131] (green upside-down triangles). 
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Fig. 47. Cross section, Z=38: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [118] (blue 
triangles), [106] (black circles) and [120] (red squares). 
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Fig. 45. Cross section, Z=36: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [76] (black 
circles), [84] (blue triangles), [81] (red squares), [83] (pink stars), [78] (green 
upside-down triangles), [115] (turquoise asterisks) and [80] (black squares). 
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Fig. 48. Cross section, Z=47: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] 
(black circles), [132] (red squares), [133] (blue triangles), [134] (turquoise 
asterisks), [135] (pink stars) and [124] (green upside-down triangles). 
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Fig. 49. Cross section, Z=48: EEDL (empty circles), BEB model (empty Fig. 52. Cross section, Z=51: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [126] squares), DM model (empty triangles) and experimental data from [102] 
(black circles). (black circles). 
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Fig. 50. Cross section, Z=49: EEDL (empty circles), BEB model (empty Fig. 53. Cross section, Z=52: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [127] squares), DM model (empty triangles) and experimental data from [102] 
(black circles), [128] (red squares) and [109] (blue triangles). (black circles). 
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Fig. 51. Cross section, Z=5(): EEDL (empty circles), BEB model (empty Fig. 54. Cross section, Z=53: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] squares), DM model (empty triangles) and experimental data from [111] 
(black circles). (black circles). 
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Fig. 55. Cross section, Z=54: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [78] (black 
circles), [76] (red squares), [84] (blue triangles), [81] (green upside-down 
triangles), [136] (turquoise asterisks), [83] (pink stars), [115] (black squares) 
and [137] (black triangles). 



Fig. 58. Cross section, Z=58: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [143] 
(black circles). 




Fig. 56. Cross section, Z=55: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [85] (black 
circles), [86] (red squares), [98] (turquoise asterisks), [138] (pink stars), [116] 
(green upside-down triangles) and [139] (blue triangles). 



Fig. 59. Cross section, Z=60: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [143] 
(black circles). 




Fig. 57. Cross section, Z=56: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [118] (pink 
stars), [140] (red squares), [106] (blue triangles), [141] (black circles), [120] 
(green upside-down triangles), [142] (turquoise asterisks). 
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Fig. 60. Cross section, Z=62: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [143] 
(black circles) and [144] (red squares). 
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Fig. 61. Cross section, Z=63: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [141] 
(black circles) and [144] (red squares). 



Fig. 64. Cross section, Z=68: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [143] 
(black circles). 
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Fig. 62. Cross section, Z=64: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [143] 
(black circles). 
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Fig. 65. Cross section, Z=69: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [144] 
(black circles). 




Fig. 63. Cross section, Z=66: EEDL (empty circles), BEB model (empty Fig. 66. Cross section, Z=70: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [143] squares), DM model (empty triangles) and experimental data from [143] 
(black circles). (black circles) and [144] (red squares). 
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Fig. 67. Cross section, Z=79: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [125] 
(black circles). 
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Fig. 68. Cross section, Z=8(): EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [145] 
(black circles), Harrison (red squares), Jones (blue triangles), Liska (pink 
stars) and Smith (green upside-down triangles) reported in [72]. 



Fig. 70. Cross section, Z=82: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] 
(black circles), [146] (red squares), [147] (blue triangles), [148] (pink stars), 
[142] (turquoise asterisks) and [149] (green upside-down triangles). 
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Fig. 71. Cross section, Z=83: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [102] 
(black circles). 
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Fig. 69. Cross section, Z=81: EEDL (empty circles), BEB model (empty Fig. 72. Cross section, Z=92: EEDL (empty circles), BEB model (empty 
squares), DM model (empty triangles) and experimental data from [118] squares), DM model (empty triangles) and experimental data from [150] 
(black circles) and [109] (red squares). (black circles). 



